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Abstract 

The objective of the present study was to investigate the efficiency of sorting procedures, as an alternative to quantitative descriptive 
analysis, to obtain a sensory map of food products. First, we investigated if sorting by a trained panel would give similar results to quan¬ 
titative descriptive analysis. Principal component analysis of quantitative descriptive data and multidimensional scaling of sorting results 
led to similar product maps and sensory description, even if slightly more detailed in quantitative descriptive analysis. Second, we exam¬ 
ined if sorting performed by trained and untrained panelists led to the same conclusions. The perceptual organisation was similar what¬ 
ever the level of panelist expertise. Finally, we investigated if sorting by untrained panelists led to consistent data. Familiarisation with 
the procedure and the products did not induce any major change. The results showed that sorting combined with verbalisation led to 
meaningful and consistent product sensory mapping, whatever the panelist’s level of training. 

© 2006 Elsevier Ltd. All rights reserved. 
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1. Introduction 

Knowing the sensory characteristics of food products 
among their competitive universe is a key priority in the 
food industry. To reach this objective, quantitative descrip¬ 
tive analysis is used to specify the nature and the intensity 
of the sensory characteristics perceived when a product is 
evaluated (Stone, Sidel, Oliver, Woosley, & Singleton, 
1974). In industry, it represents the ideal methodology 
since it is known to provide detailed information and reli¬ 
able and consistent results (Rodrigue, Guillet, Fortin, & 
Martin, 2000). However, the use of this technique raises 
several questions. First, this analytical method forces the 
panelists to dissect their perception into independent sen¬ 
sory dimensions. The validity of this approach may be 
challenged since it does not reveal the same information 
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on complex perceptions or interactions between sensory 
modalities than holistic approaches (Lawless, 1999; Saint 
Eve, Paci-Kora, & Martin, 2004). Secondly, the application 
of quantitative descriptive analysis remains time-consum¬ 
ing since the vocabulary and associated training must be 
adapted to each product space. It requires an extensive 
training to make sure that the vocabulary and the rating 
scales are used consistently and that the panel is in agree¬ 
ment and able to discriminate among the samples. 

In this context, we investigated an alternative method to 
quantitative descriptive analysis for rapid sensory mapping. 
The sorting procedure, which consists in grouping samples 
according to their similarities and differences, was investi¬ 
gated. It allows overcoming the problems mentioned above. 
Firstly, it does not require any quantitative rating system, 
nor any forced-agreement among panelists. Secondly, this 
method requires minimum training, produces little fatigue 
and boredom (Bijmolt & Wedel, 1995). Finally, it allows 
the participation of inexperienced panelists and a rapid 
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evaluation of a large number of samples (Piombino, Nickl- 
aus, Le Fur, Moio, & Le Quere, 2004). 

The sorting procedure has already been applied on a 
variety of food products, such as odorants (Heymann, 
1994; Lawless, 1989; McRae, Howgate, & Geelhoed, 
1990; Rawcliffe, Howgate, & Geelhoed, 1992), basic taste 
and salts (Lim & Lawless, 2005; Yang & Lawless, 2005) 
drinking waters (Falahee & MacRae, 1997), beers (Chollet 
& Valentin, 2001), cheese (Lawless, Sheng, & Knoops, 
1995), jellies (Tang & Heymann, 1999), yogurts (Saint Eve 
et al., 2004) and red wine (Gawel, Hand, & Francis, 2001). 
It has also been used to evaluate different materials such 
as plastic pieces (Faye et al., 2004), tactile surface texture 
(Hollins, Faldowski, & Rao, 1993) and fabrics (Giboreau, 
Navarro, Faye, & Dumortier, 2001) or even musical timbres 
(McAdams, Winsberg, Donnadieu, De Doete, & Krimp- 
hoff, 1995). 

When sorting is combined with verbal description, it 
leads to a perceptual map whose dimensions can be 
explained (Popper & Heymann, 1996). Several authors 
showed that the dimensions of multidimensional scaling 
(MDS) configurations resulting from an evaluation made 
by untrained panelists can be interpreted using the vocab¬ 
ulary generated (Chollet & Valentin, 2000; Hollins et al., 
1993; Lim & Lawless, 2005; Lawless, 1989; Lawless et al., 
1995). Lawless and Glatter (1990) showed that perceptive 
maps of odors obtained with trained or untrained panelists 
were relatively similar. Besides Chollet and Valentin (2001) 
demonstrated that vocabulary used by untrained panelists 
was not as accurate as that of trained panelists. The first 
objective of our work was to further explore the impact 
of expertise on sorting results and to confirm on a set of 
commercial products that sorting applied to trained or 
untrained panelists can lead to similar product sensory 
mapping and description. 

The efficiency of sorting has also been compared with 
quantitative descriptive analysis. Faye et al. (2004) and 
Lim and Lawless (2005) showed respectively on plastic 
pieces and solutions that sorting with untrained panelists 
leads to comparable perceptual maps than quantitative 
descriptive analysis with trained panelists. The second 
objective of the present study was to confirm this finding 
on food products, which has not been investigated yet. 

The third objective was to determine if sorting and quan¬ 
titative descriptive analysis performed both with a trained 
panel would lead to similar results. To our knowledge, this 
has never been demonstrated. Indeed, sorting has only been 
compared to free-choice profiling using untrained panelists 
(Tang & Heymann, 1999). 

The fourth objective was to determine if sorting by 
untrained panelists led to consistent data. The reproduc¬ 
ibility of sorting data has been investigated, but results 
are contradictory. Lawless and Glatter (1990) showed that 
odors perceptive maps obtained at a two weeks interval 
were similar, whereas Chollet and Valentin (2000) demon¬ 
strated that sorting results differed between two repetitions 
within a delay of two weeks. In the present study, consis¬ 


tency of sorting data was explored over a period of five 
consecutive days. 

These different hypotheses were tested on commercial 
breakfast cereals. 

2. Material and methods 

2.1. Tasting conditions 

Fourteen different commercial breakfast cereals (PI— 
PI4) with different visual, aroma and textural properties 
were assessed for their texture and flavour properties in 
mouth. However, in quantitative descriptive analysis and 
sorting with trained panelists, only 13 products were 
assessed (i.e., P14 was excluded since its recipe has chan¬ 
ged). These products presented the following advantages: 
(1) stability during the sensory evaluation since they could 
be assessed dry and at room temperature (20 °C); (2) stabil¬ 
ity over a long storage period; and (3) representing a large 
range of texture and flavour attributes. 

Samples were stored at 20 °C during the whole study. 
They were presented dry in three-digit coded transparent 
plastic pots. Sensory evaluation was conducted in an air- 
conditioned room (20 °C) and under white light in separate 
booths. 

2.2. Experiments 

Four experiments were performed: (1) a quantitative 
descriptive analysis with trained panelists, (2) a sorting 
with trained panelists, (3) a sorting with untrained panel¬ 
ists, and (4) five consecutive sorting with untrained 
panelists. 

2.2.1. Quantitative descriptive analysis with trained panelists 
Panelists: The panel dedicated to the quantitative 
descriptive analysis existed prior to the present study and 
was composed of 12 panelists extensively trained for 12 ses¬ 
sions on the use of attributes and scales to describe break¬ 
fast cereals. 

Sensory procedures: The glossary was composed of 22 
attributes describing texture and flavour (Table 1). Attri¬ 
bute intensity was scored on a scale varying from 1 to 7. 
Within a session, panelists started by evaluating the texture 
and then evaluated the flavour. Scores were directly 
recorded on a computer system using FIZZ software (Bio- 
systemes®, 1990). Samples were presented in monadic way 
and in a randomized order. Three samples were assessed 
per session and one replication was performed. 

Data analysis: The analysis was divided in two steps. 

- Sensory map of the products: 

Firstly, data were submitted to two-way ANOVAs (prod¬ 
uct, subject) to identify significant product effect (i.e., 
differences were considered as significant at p < 0.05). 
Secondly, a principal component analysis (PCA) was 
conducted on product means for all attributes. The 
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Table 1 

List of attributes used in the sensory profiling 


Texture attributes 

Flavour attributes 

Cracking-hard 

Overall flavour 

Brittle 

Cocoa 

Crispy 

Hazelnut 

Compact/dense 

Sweet 

Sticky 

Salty 

Pasty 

Bitter 

Residual grains 

Astringent 

Buttery 

Honey 

Caramel 

Cereal 

Vanilla 

Cinnamon 

Biscuit 

Persistence 


configurations visualize attributes having a communal- 
ity ^ 0.2. The communality was calculated by summing 
the squared correlation coefficients of the variable and 
the factorial dimensions (communality = r\ + rf). 

- Identification and characterization of the groups of 
products: 

Groups of products were identified by performing K- 
means clustering on products’ coordinates. One-way 
ANOVA was performed in order to identify significant 
group effects (significance level a = 5%) on the elicita¬ 
tion frequencies of the attributes (i.e., differences were 
considered as significant at p < 0.05). Significant differ¬ 
ences between groups were identified using Fisher’s least 
significant differences (LSD) multiple comparison test. 
When significant difference was observed (at p < 0.05), 
group description was composed of the attributes show¬ 
ing the significantly highest mean for the group. These 
attributes were called “key attributes”. 

2.2.2. Sorting with trained panelists 

Panelists'. The panel dedicated to the sorting was com¬ 
posed of 12 panelists (i.e., number chosen to be in the same 
conditions as in quantitative descriptive analysis). These 
panelists had a previous experience in the evaluation of 
breakfast cereals and most of them were also involved in 
the quantitative descriptive analysis, which took place 
6 months earlier. 

Sensory procedure : During a first session, the panelists 
were familiarised with the principle of the sorting proce¬ 
dure using a set of chocolates. Within a second session, 
the panelists received the entire set of breakfast cereals 
at once. They were asked to sort the products into 
groups having similar mouth properties (texture and fla¬ 
vour). No other constraint was given, except that they 
had to make at least two groups. Then they were 
invited to describe their groups. The glossary used in the 
quantitative descriptive analysis was at their disposal but 
they could also use their own terms. No replication was 
performed. 


Data analysis'. The analysis of sorting data consisted in 

two steps. 

- Sensory map of the products: 

Firstly, an individual binary dissimilarity matrix indicat¬ 
ing whether two samples were grouped together was con¬ 
structed for each panelist. Each individual matrix was 
given the same global weight by dividing the matrix by 
its average dissimilarity (otherwise individuals making 
many groups have more weight in the analysis than 
individuals making fewer groups). These weighted matri¬ 
ces were summed and the resulting dissimilarity matrix 
was submitted to the classical metric multidimensional 
scaling MDS (Togenson, 1952) using NCSS software 
(Hintze, 2001). For each dimension, the metric MDS 
minimized the stress function, which was directly related 
to the sum of squared differences between the actual dis¬ 
similarities and the estimated ones. The stress values 
were calculated for all maps, but no clear cut-off value 
was available for the actual type of rebuilt dissimilarity 
matrices. The usual cut-off value of 0.2 (Kruskal, 1964) 
was defined for real distance matrices and cannot directly 
be applied here.Secondly, vocabulary generated to 
describe the products was used to build a contingency 
table. Each term used to describe a group of samples 
was reallocated to each product of the group. We 
assumed that all the products belonging to the same 
group could be described by the same terms. The result¬ 
ing contingency table was then reduced and simplified: 
(1) Terms having similar meanings were grouped by the 
Sensory Analyst (Tables 2 and 3); (2) only terms 
having a quotation frequency higher or equal to 3% were 
considered. This percentage was calculated by dividing 
the number of quotations for an attribute by the total 
possible number of quotations. The MDS configurations 
visualize attributes having a communality ^ 0.2. 

- Identification and characterization of the groups of prod¬ 
ucts: 

A'-means clustering was performed on products’ coordi¬ 
nates to identify groups of products on configurations. 
One-way ANOVA was performed in order to identify sig¬ 
nificant group effects (significance level a = 5%) on the 
elicitation frequencies of the attributes. Differences were 
considered as significant at p < 0.05. Finally, significant 
differences between groups were identified using Fisher’s 
least significant differences (LSD) multiple comparison 
test (i.e., differences were considered as significant at 
p < 0.05). When significant difference was observed, 
group description was composed of the attributes show¬ 
ing the significant highest frequency for the group. These 
attributes were called “key group attributes”. 


2.2.3. Sorting with untrained panelists 

Panelists: The panel was comprised of 24 untrained pan¬ 
elists who had an expertise in sensory evaluation. To com¬ 
pensate for the lack of expertise while remaining in the 
feasibility limits, we doubled the number of the panel in this 
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Table 2 

Texture attributes having similar meaning and grouped in the same 
category 


Texture merged 
attributes 

Attributes having similar meaning 
and merged together 

Airy 

Airy, bubbles, foamy, empty, air 

Anguleux 

Angular, hurtul, sharp, cutting 

Brittle 

Brittle 

Compact 

Compact, dense 

Cracking-hard 

Cracking-hard, noisy cracking, 

crack, hard, hard outside, hard at the surface 

Crispy 

Crispv, noisv. crispv outside 

Crumbly 

Crumbly, break up 

Crunchy 

Crunchy, crunchy outside, crunchy-firm 

Dry 

Dry, dry vegetables 

Filled 

Filled, praline filled, stuffing 

Floury 

Floury, flour, flour particles 

Gritty 

Gritty, like sandy, sandy, not smooth, lumps, 
rough, rough on the tongue, rocky 

Humid 

Humid 

Icy 

Icy, glazed, glazing with icing sugar, 
smooth glazing 

Light 

Light 

Melting 

Melting, melts quickly, melts rapidly, rapid 
melting, melting inside, inside melting 

Onctuous 

Onctuous, creamy 

Pasty 

Pasty, pasty at the end 

Residual grain 

Residual grain 

Smooth 

Smooth 

Soft 

Soft, soft inside, tender 

Souffle 

Souffle, rice soufflees, barley soufflees, cereals 
soufflees, wheat soufflees 

Sticky 

Sticky, persistent stickiness 


The grouping was the same for all experiments. 


experiment. These panelists were selected for their motiva¬ 
tion and availability and all consumed regularly breakfast 
cereals. 

Sensory procedure & data analysis : The same procedure 
as for trained panelists was applied, except that panelists 
were asked to use their own terms to describe each group. 

2.2.4. Consistency of sorting applied to untrained panelists 

Panelists: The same 24 untrained panelists took part 
into a second experiment after a break of one week. 

Sensory procedure & data analysis: The same procedure 
as described above was applied. 

2.3. Comparison of factorial configurations 

The proximity between two factorial configurations was 
assessed by comparing the similarity of the product posi¬ 
tioning and description of the groups of products. 

The similarity of factorial configurations was assessed 
by comparing the products’ grouping on the first two axes 
of each configuration. Only the first two dimensions of con¬ 
figurations were considered, since the objective was to 
develop a useful perceptive mapping tool (i.e., four dimen¬ 
sions are difficult to plot and to compare). 

The first two factorial dimensions were rotated follow¬ 
ing the procedure described by Joliffe (2002). Since P12 
and PI3 were some reference samples, it has been decided 


Table 3 

Flavour attributes having similar meaning and grouped in the same 
category 


Flavour merged 
attributes 

Attributes having similar meaning 
and merged together 

Acid 

Acid, acid on the tongue, acidity, 
slightly acid 

Astringent 

Astringent 

Biscuit 

Biscuit, cookie 

Bitter 

Bitter, bitterness 

Buttery 

Buttery, butter 

Caramel 

Caramel, caramelized 

Cereal 

Natural cereal, oats, maiize, wheat, 
particles of wheat, semolina, wholewheat 

Chemical 

Artificial, chemical, plastic 

Chocolate 

Chocolate, sweet chocolate, milky 
chocolate, fatty chocolate 

Cinnamon 

Cinnamon 

Cocoa 

Cocoa, bitter chocolate, black chocolate 

Floury 

Floury, wheatmeal, floury particles 

Fruity 

Fruity, rasberry, citrus fruit 

Hazelnut 

Hazelnut 

Honey 

Honey 

Insipid 

Insipid, without taste, without 
particular taste, without precise taste, 
poor in aroma, short in mouth 

Malt 

Malt 

Old 

Old, old paper 

Overall 

Strong overall intensity, tasty, rich in aroma 

Persistent 

Persistent, long after taste 

Popcorn 

Popcorn 

Praline 

Praline, praline coulis 

Pungent 

Pungent, pepper 

Rice 

Rice 

Roasted 

Roasted, coffee, torrefaction, roasted 
cereals, toasted, burnt sugar, roasted maize 

Salty 

Salty, salt, after taste salty, a touch of salt 

Spicy 

Spicy, spices, curry, saffron, 
ginger, gingerbread 

Sweet 

Sweet, sugar, icing sugar 

Vanilla 

Vanilla, sweet vanilla 


The grouping was the same for all experiments. 


to rotate the maps in order to obtain P12 (x > 0, y = 0) 
and PI3 (no constraint on xj > 0). 

In addition, the RV-coefficient (Robert & Escofiier, 
1976), a multivariate generalization of the correlation coef¬ 
ficient, was calculated to provide a global index of the 
proximity of the two factorial configurations. An excellent 
agreement between configurations corresponds to a coeffi¬ 
cient value close to 1. Faye et al. (2004) concluded to a 
good agreement between two configurations at RY-values 
close to 0.77, whereas Tang and Heymann reported an 
agreement at RV values of 0.68. Description of the same 
groups resulting from two different approaches were com¬ 
pared by looking at the group key attributes. 

3. Results 

3.1. Quantitative descriptive analysis 

The first two dimensions of the PCA (Fig. 1) account for 
66% of the total inertia. Four groups were identified on 
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Fig. 1. First factorial maps of PCA issued from quantitative descriptive 
analysis with trained panelists. Ellipses identified groups according to K- 
means clustering. * indicates an attribute that significantly discriminates 
the groups of products. 

PCA by performing A-means clustering: P2-P9 PI 2 
(group 1); P7-P11 (group 2); P1-P5 (group 3) and P3- 
P4-P6 P8 P10-P13 (group 4). 

Two-way ANOVAs showed significant product effect on 
all 22 attributes. Among these 22 attributes, 20 were repre¬ 
sented on the first two dimensions of PCA (communality ^ 
0.2). 

One-way ANOVA showed significant group effect on 18 
attributes. The key attributes that characterize each group 
are presented in Table 4. 


3.2. Sorting with trained panelists 

The first two dimensions of the MDS configurations 
(Fig. 2) represent 53% of the total variance. A'-mcans clus¬ 
tering identified four groups: P2-P9 PI 2 (group 1); P7-P11 
(group 2); PI P5-P10 (group 3) and P3 P4 P6 P8 PI 3 
(group 4). 

The final list used to describe the groups was composed 
of 36 attributes. Flowever only 15 of them were represented 
on the two first dimensions of MDS (communality > 0.2). 

Results of one-way ANOVA showed a significant group 
effect on 11 attributes. The key attributes that characterize 
each group are presented in Table 4. 

3.3. Sorting with untrained panelists 

The first two dimensions of the MDS configurations 
(Fig. 3) represent 55% of the total variance. A'-means 
clustering identified four groups: P2 P9-P12 (group 1); 
P7-P11-P14 (group 2); PI P5-P13 (group 3) and P3-P4- 
P6-P8-P10 (group 4). 

The final list used to describe groups was composed of 
64 attributes. However, 17 of them were represented on 
the two first MDS dimensions (communality ^ 0.2). 

One-way ANOVA showed significant group effect on 13 
attributes. The characterization of groups is described in 
Table 4. 

3.4. Sorting with untrained panelists—day 1 to day 5 

Fig. 4 represents the MDS configurations issued from 
day 1 to day 5. The total variance explained by the first 
two dimensions of each configuration varied from 50% to 
53% (Table 5). 


Table 4 

Composition and characterization of groups issued from profiling with trained panelists, sorting with trained panelists and sorting with untrained panelists 



Quantitative descriptive 
analysis with trained panel 

Sorting with trained panel 

Sorting with untrained panel 

Number of panelists involved 

12 

12 

24 

Number of attributes shown on the first two 
axes of factorial maps 

20 

15 

17 

Percentage of variance explained by the first two a 

xes 66% 

53% 

55% 

Number of groups identified visually 

4 

4 

4 

Number of groups identified with tmeans 

4 

4 

4 

Group 1 

P2, P9, P12 

Cracking-hard, crispy, 
cocoa, bitter 

P2, P9, P12 

Cracking-hard, cocoa, 
chocolate, vanilla 

P2, P9, P12 

Cracking-hard, crumbly, 
crunchy, cocoa, bitter, 
chocolate, vanilla 

Group 2 

P7, Pll 

Sticky, pasty, hazelnut, 
salty, overall, astringent 

P7, Pll 

Hazelnut, salty 

P7, Pll, P14 

Melting, gritty, filled, praline 

Group 3 

PI, P5 

Sticky, pasty, sweet, 
buttery, vanilla, biscuit 

PI, P5, P10 

Vanilla, biscuit 

PI, P5, P10 

Vanilla, biscuit 

Group 4 

P3, P4, P6, P8, P10, P13 
Brittle, honey, not compact 

P3, P4, P6, P8, P13 
Chocolate, cocoa, 
brittle, crispy, airy 

P3, P4, P6, P8, P13 

Crispy, light, chocolate 
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Fig. 2. First factorial maps of MDS issued from sorting with trained 
panelists. Ellipses identified groups according to ^1-means clustering. * 
indicates an attribute that significantly discriminates the groups of 
products. 



Fig. 3. First factorial maps of MDS issued from sorting with untrained 
panelists. Ellipses identified groups according to ^1-means clustering. * 
indicates an attribute that significantly discriminates the groups of 
products. 

On each sensory map, the same four groups were visu¬ 
ally identified: P2-P9-P12 (group 1); P7-P11-P14 (group 
2); P1-P5-P10 (group 3) and P3 P4 P6 P8 P13 (group 
4). However, clustering performed with A'-mcans showed 
that groups 3 and 4 were very close and could be merged 
on configurations issued from day 1, day 3 and day 4. 

In general, the composition of the final list used to 
describe groups varied from 89 to 103 attributes. But only 


17-21 of them were represented on the two first MDS 
dimensions (communality > 0.2). Significant group effect 
was identified for 13-15 attributes (i.e., according to one¬ 
way ANOVA). The key attributes describing groups are 
presented in Table 5. 

3.5. Sorting performed by trained panelists provides a 
product mapping similar to quantitative descriptive analysis 

Products were grouped similarly in MDS configurations 
issued from sorting and in PCA resulting from quantitative 
descriptive ratings (Table 4). Only the position of one prod¬ 
uct (P10) differed. 

The RV value (respectively Pearson correlation coeffi¬ 
cient r on interproduct distances) was quite low when con¬ 
sidering only the two first dimensions of the MDS 
(RV = 0.31, r = 0.38 on interproduct distances) but it 
reaches acceptable values (RV = 0.67, r = 0.65) when con¬ 
sidering 4-MDS dimensions vs. 2-PCA dimensions. How¬ 
ever, since the same groups were identified on the first 
two dimensions of MDS configurations as on the first four 
ones (according to V-means), we limited the comparison to 
two dimensions. 

Products were described by more attributes in quantita¬ 
tive descriptive analysis (i.e., 20) on the first two axes of 
products maps, but there were more attributes discriminat¬ 
ing groups in quantitative descriptive analysis (18 vs. 11). 
Description of the groups was very similar (Table 4): group 

I was described cracking-hard and cocoa/chocolate; group 
2: hazelnut and salty; group 3: vanilla and biscuit; and 
group 4: brittle/airy and not compact. 

But some differences were observed. In sorting, crispy 
was associated to airy (r = 0.63) and brittle (/ = 0.68) 
whereas in quantitative descriptive analysis, it was rather 
associated to cracking-hard (r = 0.85). Sweet was also not 
used similarly. In quantitative descriptive analysis, sweet 
was linked to biscuit ( r = 0.82), vanilla (r = 0.68) and but¬ 
tery notes (r = 0.67) whereas in sorting, sweet was nega¬ 
tively correlated with spicy notes (r = —0.72) and was not 
associated to biscuit notes (r = 0.09). Finally, additional 
attributes (i.e., sticky, pasty, overall, astringent, bitter 
and honey) discriminated groups in quantitative descriptive 
analysis, but not in sorting. 

3.6. Sorting performed by trained and untrained 
panelists provides a similar product mapping 

Similar groups of products were identified on the first 
two dimensions of MDS configurations (Figs. 2 and 3). 
Only two products, P10 and P13, were positioned differ¬ 
ently (Table 4). When considering the two first MDS 
dimensions, the RV value (Table 6) was quite high 
(RV = 0.69, r = 0.68 on interproduct distances). Products 
were described by approximately the same number of attri¬ 
butes and with a similar number of attributes discriminat¬ 
ing groups (i.e., 13 for sorting with untrained panelists vs. 

II for sorting with trained panelists). Description of the 
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Fig. 4. (a)-(e) First factorial maps of MDS issued from sorting with untrained panelists on day 1 (a) to day 5 (d). Ellipses identified groups according to 
R'-means clustering. * indicates an attribute that significantly discriminates the groups of products. 
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Table 5 

Composition and characterization of groups issued from sorting with untrained panelists from day 1 to day 5 



Sorting with 
untrained 
panel—day 1 

Sorting with 
untrained 
panel—day 2 

Sorting with 
untrained 
panel—day 3 

Sorting with 
untrained 
panel—day 4 

Sorting with 
untrained 
panel—day 5 

Number of panelists 

24 

24 

24 

24 

24 

involved 

Number of attributes 

18 

18 

22 

18 

23 

presented on the 
first two axes of maps 

Percentage of variance 

50% 

51% 

50% 

50% 

53% 

explained by the first 

Number of groups 

4 

4 

4 

4 

4 

identified visually 

Number of groups 

4 or 3 

4 

4 or 3 

4 or 3 

4 

identified 
with ^T-means 

Group 1 

P2, P9, P12 

P2, P9, P12 

P2, P9, P12 

P9, P12 

P2, P9, P12 


Cracking-hard, 

Cracking-hard, dry, 

Cracking-hard, crunchy, 

Cracking-hard, icy, 

Cracking-hard, 


crunchy, cocoa 

sweet, cocoa, bitter 

icy, sweet, cocoa, persistent 

sweet, cocoa, bitter 

crunchy, icy, 
cocoa, chocolate, 
sweet, bitter taste 

Group 2 

P7, Pit, P14 

P7, Pll, P14 

P7, Pll, P14 

P7, Pll, P14 

P7, Pll, P14 


Filled, crunchy, 

Filled, melting, crunchy. 

Crunchy, melting. 

Melting, gritty, filled. 

Crispy, melting. 


salty, hazelnut 

salty, bitter, praline, hazelnut 

filled, gritty, salty 

salty, bitter, praline, 
hazelnut, persistent 

hazelnut, salty, 

Group 3 

PI, P5, P10 

PI, P5, P10 

PI, P5, P10 

PI, P5, P10 

PI, P5, P10 


Souffle 

Souffle 

Souffle 

Airy, souffle, bitter 

Crispy, souffle, 
airy, salty 

Group 4 

P3, P4, P6, P8, P13 

P3, P4, P6, P8, P13 

P3, P4, P6, P8, P13 

P3, P4, P6, P8, P13 

P3, P4, P6, 

P8, PI 3 


Airy, souffle 

Souffle, airy, sweet 

Souffle, airy, sweet 

Souffle, sweet 

Airy, souffle, 
light, crispy 


Table 6 

RV-coefficients obtained when comparing 2-PCA or 2-MDS dimensions with 1-7 MDS dimensions for the different sortings 

Dimensions 

2 PCA dimensions vs. 1-7 
MDS dimensions from 
sorting with trained panel 

2 MDS dimensions with trained panel 
vs. 1-7 MDS dimensions from 
sorting with untrained panel 

2 MDS dimensions—day 1 with untrained panel vs. 
1-7 MDS dimensions day 2/5 with untrained panel 

Day 2 Day 3 Day 4 Day 5 

1 

0.17 

0.56 

0.67 

0.80 

0.80 

0.76 

2 

0.31 

0.69 

0.77 

0.83 

0.85 

0.81 

3 

0.60 

0.74 

0.78 

0.86 

0.68 

0.84 

4 

0.67 

0.64 

0.74 

0.74 

0.80 

0.78 

5 

0.61 

0.76 

0.80 

0.88 

0.83 

0.84 

6 

0.57 

0.82 

0.70 

0.81 

0.74 

0.75 

7 

0.53 

0.83 

0.74 

0.83 

0.80 

0.79 


groups was very similar in MDS configurations (Table 4). 
Group 1 was described as being cracking-hard/crumbly/ 
crunchy, cocoa, chocolate and vanilla; group 2: hazelnut/ 
pralin, group 3: vanilla/biscuit and group 4: crispy/airy/ 
light/souffle/brittle texture and chocolate flavour. Some 
differences were observed. Firstly, groups were discrimi¬ 
nated by more texture attributes in sorting with untrained 
panelists (i.e., crumbly, crunchy, melting, gritty and filled). 
Secondly, some descriptors were specific to each panel: 
untrained panelists described group 1 as bitter and trained 
panelists described group 2 as salty. 


3. 7. Product mapping and description issued from sorting 
with untrained panelists are consistent over time 

The same groups of products were identified on the first two 
dimensions of MDS configurations between day 1 to day 5 
(Fig. 4). The RV values between the first two MDS dimensions 
were very high (Table 6), ranging from RV = 0.77 to RV = 
0.85 ( r — 0.94 to r = 0.97 on interproduct distances). 

Concerning the product description, we observed that 
the number of attributes (Table 5) represented on the first 
two MDS configurations tended to increase from day 1 to 
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day 5 (i.e., increase of 21%). However, groups were dis¬ 
criminated by approximately the same number of attri¬ 
butes in day 1(13) and day 5 (14) and description of the 
groups was very similar on MDS configurations. Group 1 
was described cracking-hard, crunchy, sweet, cocoa, choc¬ 
olate and bitter; group 2: filled, melting, icy, praline, hazel¬ 
nut, and salty; group 3: souffle and airy; and group 4: airy, 
souffle, light and sweet. 

4. Discussion 

4.1. Sorting applied to trained panelists is a time-efficient 
alternative to quantitative descriptive analysis for sensory 
mapping 

The two methodologies applied to trained panels gave 
similar results in terms of factorial configurations and of 
terms used to describe the groups. 

However, the two approaches differed in the way per¬ 
ceptual dimensions were expressed. On the one hand, we 
observed that four MDS dimensions were required to show 
the same information as 2-PCA dimensions. This suggested 
that quantitative descriptive analysis provided a more 
accurate estimate of the magnitude of product distances. 
However, since the same groups were identified on the first 
two dimensions of MDS configurations as on the first four 
dimensions (i.e., according to A'-mcans clustering), we con¬ 
cluded that 2-MDS dimensions were sufficient to represent 
the key information. 

On the other hand, some differences in the correlation 
between attributes were observed. For example, the crispy 
term was associated to airy/brittle attributes in sorting, 
whereas it was linked to cracking-hard term in quantitative 
descriptive analysis. This raises two questions: (1) the valid¬ 
ity of the agreement obtained in quantitative descriptive 
analysis and (2) the validity of the definition chosen. This 
question particularly arises for multidimensional attributes, 
like crispiness. This attribute is more panelist-dependent 
and the agreement obtained after an intensive training does 
not necessarily reflect what untrained panelists reported. 
Roudaut, Dacremont, Valles Pamies, Colas, and Le Meste 
(2002) pointed out that there is no guarantee that two inde¬ 
pendent trained panels would reach an agreement on the 
meaning of the attribute crispy. They also suggested that 
working with untrained panelists might be a way to avoid 
the adulteration of the crispy concept caused by extensive 
training. Besides, the sweet term was not used similarly in 
the two approaches. In quantitative descriptive analysis, 
sweet was associated to biscuit, buttery and vanilla notes, 
whereas in sorting it was used to describe products having 
a light spicy note. This observation showed that according 
to the procedure, panelists did not make the same associa¬ 
tions between taste (sweet) and olfactory properties. These 
findings agree with Saint Eve et al. (2004) who showed that 
conventional profiling methods did not reveal the same 
information regarding sensory interactions than holistic 
approaches, such as sorting. 


Finally, sorting was quite efficient to obtain a sensory 
mapping of a large set of products. In the present study, 
the sensory mapping was achieved faster in sorting in com¬ 
parison to a sensory quantitative descriptive analysis (27% 
of time reduction). This efficiency could be improved by 
using an automatic data acquisition system. In the latter 
case, the time reduction was estimated to 55%. 

4.2. The MDS configurations were similar whatever the 
panelist’s level of expertise 

The results showed that MDS configurations obtained 
by trained and untrained panelists were comparable. This 
suggested that the panelist’s level of expertise had a minor 
impact on products configurations. These results confirmed 
those obtained recently by others who showed that sorting 
with an untrained panel and sensory profiling with a trained 
panel lead to comparable results (Faye et al., 2004; Lim & 
Lawless, 2005). Plus, we showed that untrained panelists 
are able to bring semantic descriptive information, whereas 
Chollet and Valentin (2001) demonstrated that the vocabu¬ 
lary generated by untrained panelists was hedonic. 

To conclude, we would consider that sorting can be 
applied to untrained panelists for rapid sensory mapping. 

4.3. The familiarisation with the sorting procedure and the 
products did not induce any major changes in MDS 
configurations 

One advantage of sorting is its rapidity to obtain a prod¬ 
uct sensory mapping, in comparison to quantitative descrip¬ 
tive analysis. No training and only one session are required 
for the product evaluation. The present results showed that 
product mapping and description issued from sorting with 
untrained panelists were quite consistent over time. This 
finding confirmed results obtained by Lawless and Glatter 
(1990) who demonstrated the relative consistency of sorting 
data on a set of odors which does not differ in appearance. 

However, Chollet and Valentin (2000) showed that 
MDS configurations differ between two repetitions within 
a delay of 20 min, especially for trained subjects. In our 
case, the appearance of products may have facilitated for 
consistency, whereas Chollet and Valentin (2000) used 
beers which were quite close in aspect. 

To conclude, we would consider that replication may 
not be needed in sorting. 

5. Conclusion 

Sorting carried out by trained panelists provided a prod¬ 
uct map similar to quantitative descriptive analysis, even if a 
larger number of attributes were discriminating in profiling. 
Thus, to save time, sorting can be performed with a trained 
panel to have a rough description of a product set. In addi¬ 
tion, sorting by untrained panelists provided product group¬ 
ing and description similar to trained panelists. This means 
that untrained panelists can be recruited to carry out sorting. 
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This poses an alternative when panel availability is a prob¬ 
lem. Finally, sorting by untrained panelists produced consis¬ 
tent product maps over time. Thus replication may not be 
needed in sorting. This study confirmed that sorting is a 
time-effective alternative to a quantitative descriptive analy¬ 
sis for a rapid sensory mapping (e.g., to screen prototypes or 
to assess all brands from a given product category). 

This study strengthened the advantage of sorting in 
comparison to a quantitative descriptive analysis. The first 
advantage is that it requires minimum training and that it 
can be performed by untrained panelists. This make sorting 
more appealing than quantitative descriptive analysis 
where a long and costly time is allocated to panel training 
and to repeated products evaluation. The second advan¬ 
tage is that it does not require any selection of attributes 
in advance. This avoids biasing panelists or submerging 
them with a long and unrealistic list of attributes, especially 
when describing complex food products. 

However, sorting has some limits. One obvious limitation 
of sorting is the number and the nature of the products to be 
assessed. We would recommend to apply it to a range of 6- 
15 samples. Its application should also be limited to foods 
whose physico-chemical (temperature, structure) and subse¬ 
quent sensory properties remain stable throughout the sen¬ 
sory sessions. However, it is not impossible to apply 
sorting to such products if they are cautiously served in 
adapted packaging or conditions (i.e., in double boiler or 
on using warmer). A second limitation is linked to the num¬ 
ber of panelists needed. Here, we recruited 24 panelists, but 
the group size recommended to get a stable configuration 
has to be further investigated. A third limitation is the simul¬ 
taneous presentation of the whole product set. Since the sen¬ 
sory positioning of a specific product depends on the other 
products simultaneously evaluated, we would not recom¬ 
mend to apply this procedure for shelf life studies. Finally, 
sorting is limited if the objective is to precisely quantify dif¬ 
ferences between products (e.g., to guide product optimiza¬ 
tion). In this case, we would recommend to perform a 
quantitative descriptive analysis with a trained panel. 
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